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ABSTRACT 

\ 

A construction  is  given  for  a stationary  sequence  of  random  variables 
{X±}  which  have  exponential  marginal  distributions  and  are  random  linear 

combinations  of  order  one  of  an  i.l.d.  exponential  sequence  {e,}.  The  joint 

<.  1 

and  trivariate  exponential  distributions  of  Xi_^,  X^  and  X^+^  are  studied, 
as  well  as  the  intensity  function,  point  spectrum  and  variance  time  curve  for 
the  point  process  which  has  the  {X^}  sequence  for  successive  times  between 
events.  Initial  conditions  to  make  the  point  process  count  stationary  are. 
given,  and  extensions  to  higher  order  moving  averages  and  Gamma  point  processes 
are  discussed. 


1.  Introduction 


In  this  paper  we  discuss  the  stationary  sequence  of  random  variables 
{X^}  which  are  formed  from  an  independent  and  Identically  distributed 
exponential  sequence  {e^}  according  to  the  linear  model 
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with  probability  6; 


(0*8*1,1-0,11, ±2,...).  (1.1) 


^ 8e^  + with  probability  1-8. 

In  fact,  the  {X^}  fora  a sequence  of  exponential  random  variables,  and  It  will 
be  seen  from  (1.1)  that  adjacent  members  will  be  correlated.  Such  a type  of 
first  order  moving  average  model  arose  out  of  the  companion  paper,  Gaver  and 
Lewis  (1975);  there  the  first  order  autoregressive  model 

Xi  “ pXi-l  + ei  (1  • 0,±1,±2,...),  (1.2) 


with  exponential  marginal  distributions  for  the  {X^>  Is  Investigated.  It  Is 
found  there  that  the  must  be  a mixture  of  a discrete  component  at  zero  and 

an  exponential  variable.  The  motivation  behind  both  models  (1.1)  and  (1.2) 
was  three-fold:  partly  as  an  alternative  to  the  normality  theory  of  time 

series,  partly  as  a model  for  correlated  positive  random  variables  with  expo- 
nential marginal  distributions  but  chiefly  as  a simple  point  process  model  with 
which  to  analyze  non-Poisson  series  of  events  and  to  study  the  power  of  Poisson 
tests — particularly  in  situations  where  there  Is  no  obvious  physically  motivated 
model. 

In  the  present  paper  we  give  a fairly  complete  picture  of  the  model  (1.1), 
which  will  be  called  EMA1  (exponential  moving  average  of  order  1),  as  a station- 
ary point  process.  Distributions  of  the  sums  of  the  X^  are  obtained  and  lead 
to  counting  properties  of  the  process;  the  joint  distributions  of  two  and  three 
adjacent  intervals  X^  are  derived  and  appear  to  be  new  bivariate  and  trivar- 
iate exponential  distributions.  The  distributions  are  investigated  through 
their  conditional  means  and  variances,  and  computations  of  a conditional  correlation 


z 


are  given.  Extensions  of  the  model  snd  estimation  problems  are  briefly 
discussed. 

In  developing  the  properties  of  the  process  we  will  also  point  out 
similarities  to  a backward  first  order  moving  average  which  Is  defined  as 

!0e^  with  probability  0, 

«*0*l;l-O,±l,±2,...)  . (1.3) 

0eA  + ei_1  with  probability  1-0. 

Properties  of  the  processes  are  very  similar,  but  those  of  the  forward 
model  (1.1)  have  simpler  derivations. 

It  should  also  be  noted  that  the  model  (1.1)  can  be  written  as  a very 
special  type  of  linear  model  with  random  coefficients! 

Xi  “ Bci  + Iiei+i  (0*6*1 » 1 - 0,±1,±2, . . .) , 

where  the  1^  are  l.i.d.  Bernoulli  random  variables  which  are  1 with 
probability  1-0  and  0 with  probability  0.  This  characterization  is  not 
very  helpful  for  the  first  order  model;  the  main  point  is  that  since  the 
random  coefficient  has  a probability  which  is  just  the  parameter  0,  many 
of  the  theorems  for  linear  processes  are  not  applicable. 


2.  Some  Basic  Aspects  of  the  EMA1  Model 


The  almplest  aspect  of  the  EMA1  model  Is  the  exponential  marginal 

distribution  of  the  Intervals  (X^);  in  point  process  terminology  (see  e.g. 

Lawrence,  1972)  this  Is  the  synchronous  distribution  of  intervals  and  refers 

to  the  distribution  of  the  interval  from  an  arbitrarily  chosen  event  to  the 

next  event.  For  the  Laplace  transform  of  its  probability  density  function 

(p.d.f.)  f (x),  we  write 
Xi 


fv 


-sX 

E(e  *) 

-sBe  -sBe  -se 

E(e  ^B+EU  1 i+1}(l-B) 


(2.1) 


using  (1.1).  Now  the  1.1. d.  random  variables  e^  have  exponential  distributions 
with  parameters  X,  say.  and  so  their  Laplace  transform  is  X/(X+s).  Thus 
(2.1)  becomes 

fX4^  " X+Bs  ’ 0 + X+Bs  * X+s  * “ X+^  • 

This  demonstrates  that  the  X^  have  identical  exponential  distributions  as 
asserted.  The  parameter  X is  thus  the  number  of  events  per  unit  time,  or 
the  rate  of  the  point  process. 

The  correlation  between  and  X^+^  is  easily  obtained  on  consid- 
ering the  product  of  X^  from  (1.1)  with 


(6ei+l 

with  probability  B, 

x «< 

1+1  ) 

(6ei+l  + ei+2 

with  probability  (1-B) 

Thus,  again  using  straightforward  conditioning  arguments, 


A 


4 


+ E(82£iE1+1+S£iE1+2)B(l-6) 


+ E(B2EiEi+1-^E2+1)B(l-B) 


E ( d 2 e ie  i+l-^ e ie i+2"* i+lC i+2+e e i+1  * (1'P)  2 ’ 


and  simplification  of  this  result  leads  to 

01  - corrCX^X^)  - B(l-B).  (2.2) 

By  the  construction  of  EMA1,  the  higher  order  serial  correlations  will  be  zero, 
and  t-.us  the  snectral  density  of  intervals  (Cox  and  Lewis,  1966,  p.  70), 


oo 

*,.(«)  * “ {1  * 2 l 0.  cos(kw)}. 

(OiCUBCTT)  , 

k-1 

f ,(m)  ■ — (1  2S(1-B)cob(  to)}. 

IT 

(Osokit)  . 

(2.3) 

The  result  (2.2)  is  the  greatest  limitation  of  the  EMA1  model  since  it  implies 
that  the  first  order  serial  correlation  is  non-negative  and  bounded  by  1/4; 
this  may  be  comoared  with  an  ordinary  MAI  model  assuming  two-sided  dis- 

tributions of  mean  zero  for  which  |p^|  s£  1/2.  In  both  cases  it  can  be 
anticipated  that  the  restrictions  are  a consequence  of  the  linearity  of  the 
mode Is . 

A further  simple  aspect  of  the  EMA1  model  is  that  the  {X^}  sequence 
reduces  to  the  Poisscr.  pro'-tss  when  6 ■ 0 or  1,  and  this  gives  checks  on 


most  of  our  results.  Me  riav  also  note  that  the  moving  average  is  taken  in  the 
frr*T*ird  sense;  the  backward  model  (1.3)  could  equally  have  been  treated. 


although  producing  different  but  similar  results.  This  serves  to  emphasize 
that  there  is  no  tlae-reverslbllity  in  the  process,  in  the  sense  that 
does  not  have  the  same  joint  probability  distribution  as 
{X_. , . . . .X^)  for  all  finite  k,  where  k > 2. 


3. 


Distributions  of  Suns  and  Counts  In  (X^)  Sequence 

In  the  point  process  theory  of  the  model,  the  distribution  of  the  sums 

T = X-+...+X  are  very  useful;  if  these  can  be  obtained  then  the  distrlbu- 
r 1 r 1 

tions  of  counts,  both  in  the  synchronous  and  asynchronous  mode,  can  then  be 
derived.  As  shewn  in  Cox  and  Lewis  (1966,  Chapter  4)  for  instance,  these 
then  lead  to  the  second  order  properties  such  as  the  intensity  function,  the 
(Bartlett)  snectrum  of  counts  and  the  variance  time  curve.  It  is,  therefore, 
a particularly  attractive  feature  of  the  EMA1  model  that  the  distribution  of 
the  may  be  obtained,  and  we  shall  now  give  a simple  derivation. 

Define  <Ks)  as  the  Laplace  transform  of  the  p.d.f.  of  the  e^  distri- 
buticn:  except  where  otherwise  remarked  this  distribution  is  exponential  of 
parameter  A ar  so  U»(s)  - A/(A+s).  Define  the  double  Laplace  transform 
(*r  equivalently  the  joint  moment  generating  function)  of  Tr  and  Er+1»  as 

”S l^r_S 2Er+l 

- E(e  x r c A)  for  r - 1,2 (3.1) 

r i. 


For  ; - 1,  we  have 

-s.X„-s„e 


-7-0  -S  Be  ~S  E -S.Bc  -(s  +S  )E 

i(s1,s2)  - E(e  1 1 2 2}  - E(e  1 1 2 2}B  + E(e  1 1 12  2>(1-B) 


= tI>(Bs1)[B*(s2)  + (1-B)4'(s1+s2)] 


(3.2) 


and  we  shall  write 


tKsj^Sp)  = BiKs2)  + (l-B)iKs1+s2) . (3.3) 

This  is  the  double  Laplace  transform  of  a joint  distribution  in  which  the 
first  -'nriable  has  mass  B at  zero  and  with  probability  (1-B)  is  exponen- 
tial distributed.  We  shall  now  relate  ^(s^.s^  and  * Since 
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T - T . + X 
r r-1  r 


+ 0er  with  probability  0 

T , + 0c  +e  with  probability  1-0, 

r-i  r rti 


we  have 


♦r<V*2> 


i 


-S.T  .-8.0C  -(s.+80)C 


E,£-alTr-r*l6£r-2Er-l)e  + E{e  -l‘r-1  "l-'r 


*r-l*8l,Psl^82)0  + ♦r_1(®1»®81)'l'(81+82)(1“B^ 


Xl-0) 


- [0«(fl2)  + (1"0)'I»(s1+82)  J^r-l^®!*®8!^  * 


(3.4) 


Solving  (3.4)  gives. 


r-1. 


♦r(8i»82)  “ *(Bs1)N'(81*Bs1)]  if»(8lf82). 


(3.5) 


and  setting  ■ 0,  we  have  for  the  Laplace  transform  of  the  p.d.f.  of  Tr> 

♦r(s)  - [0iK0s)  + (1-0)<K0s)<K8)][0K0s)  + (l-0)<K(l+0)s)]r’1  (3.6) 


1 \ 1(1+208) 

X+s  \(X+208){X+(1+0)s] 


(3.7) 


This  is  our  required  result;  from  (3.7)  it  will  be  observed  that  is  dis- 
tributed like  the  sum  of  r independently  distributed  variables,  such  as  in 
a delayed  renewal  process,  although  these  are  not  X variables.  The  structure 
of  (3.6)  or  (3.7)  is  explained  by  the  fact  that  the  number  of  intervals  which 
are  of  the  06^  form  or  0e^  + form  are  binomially  distributed  with 

parameter  0 or  1-0;  further  consideration  of  the  adjacencies  of  the  two 
types  of  intervals  than  leads  to  the  terms  in  the  binomial  expansion  of  (3.6)  . 
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We  now  obtain  the  distribution  of  N^\  the  synchronous  counting  process 
of  number  of  events  occurring  in  the  interval  (0,t]  beginning  at  an  arbitrary 
event;  this  is  related  to  the  distribution  of  through  the  equivalence  of 

the  events  < r and  > t for  r > 1.  Let  Ff(t)  denote  the  distri- 

bution of  T , and  then  since 
r 


Prob{u[f)  - r}  - Fr(t)  - F^t), 


r i 0, 


with  Fg(t)  5 1 for  t i 0,  we  have  for  the  p.d.f.  of 


N 


(f) 


E{z  } « i|>f(z;t)  «=  l zr[Fr(t)  - F ..(t)] 

r-0 


- 1 + (z-1)  l zr-1F  (t) . 

r-1  r 


Inserting  (3.7)  in  the  Laplace  transform  of  (3.9)  gives 

* . . B(l+B)s2  + [-B(l-B)gf2B+l]A8  + l2  . 

V"’8'  (s-bX)  [8 (1+8)6*-  + (l+2B-2Bz)As  + (l-z)A^] 


(3.8) 


(3.9) 


(3.10) 


This  result  is  required  in  Section  4 to  follow. 
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4.  The  Intensity  Function  and  Spectrum  of  Counts 


The  intensity  function  of  a point  process  is  the  derivative  with 
respect  to  t of  E{N^}  and  will  be  denoted  by  m^(t).  The  (Bartlett) 
spectrum  of  counts,  the  Fourier  transform  of  the  covariance  density  of  the 
differential  counting  process,  then  has  the  simple  expression 


g+(u>)  ■ {1  + m*(it»))  + m*(-iu>)},  (4.1) 

where  m*(s)  is  the  Laplace  transform  of  m^(t);  this  expression  for  g+(w) 
is  derived  in  Cox  and  Lewis  (1966,  Section  4.5). 

For  the  EMA1  process,  the  result  from  (3.10)  is  that 


_ 1(1+B8){A+(1+6)b} 

f(s)  B(14*)s(A^){s+A/(Bz+B)}  * 


(4.2) 


In  inverting  the  Laplace  transform  (4.2)  it  will  be  noted  that  the 
case  82  + B “ 1,  i.e.  B a 0.6185,  must  be  treated  separately  since  there 
will  then  be  a factor  (A+s)2  in  the  denominator.  Partial  fraction  expansions 
and  their  inversion  then  give,  for  t Jfc  0, 

mf(t)  - AU  + f^+gll  {e’Xt/(fj2+|J)  - e~Xt  ] (B^l),  (4.3) 

- Atl  + B3Ate"Xt]  (B^B-l).  (4.4) 


We  see  in  both  cases  that  the  initial  value  of  m^(t)  is  A and  that  they 
both  Increase  until  maximum  values  are  obtained  at  t ■ A ^(B^B)  * log[(B2+B)/ 
(B^+B-l)  ] and  at  t ■ A ^ respectively  for  (4.3)  and  (4.4);  both  functions 
then  decrease  exponentially  to  A.  There  is  no  apparent  reason  for  the 
B2  + 8 * 1 case.  When  B ■ 0 or  1 both  functions  are  constant  at  A,  as 
is  appropriate  to  the  Poisson  process. 
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The  function  m^(t)  Is  plotted  In  Figure  1 for  several  values  of  0. 

The  spectrum  of  counts  follows  easily  by  inserting  (4.2)  into  (4.1) , and  has 
the  expressions 

M")  * 7 I1  + 212  |SSl[(S“+8)^2+xii  - (8^1)  W-5) 

-M1  + 2‘2s3[  TSw]}  (B*«-l).  (4.6) 

We  observe  that  both  these  are  ratios  of  4th  order  polynomials  in  u.  Esti- 
mation of  both  m^(t)  and  gx(u))  given  an  actual  sequence  of  interevent  times 
is  considered  in  Cox  and  Lewis  (1966,  Chapter  5);  in  practice  these  would  then 
be  compared  with  our  given  theoretical  functions  which  are  graphed  in  Figure  2. 

Note  that  unlike  the  2nd  order  joint  moment  functions  and  f+(w) 

for  intervals,  the  second  order  moment  functions  for  counts  m^(t)  and  g+(u>) 
do  discriminate  between  the  cases  where  the  parameter  is  0 or  (1-0). 

However  the  Rraphs  in  Figure  2 indicate  that  the  count  spectra  of  models  with 
6 in  the  range  (0.25,  0.75)  are  fairly  close  to  each  other;  therefore,  the 
spectrum  will  not  be  entirely  suitable  for  discriminating  between  different 
t values  for  small  sample  sizes. 

The  variance  time  curve  is  considered  in  Section  7,  along  with  the 
stationarv  initial  conditions  for  the  process. 
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5.  The  Joint  Distribution  of  X.  and  X.., 

— 1 — 1+1 

We  now  discuss  the  joint  distribution  of  X^  and  X^  which  will 
be  a bivariate  exponential  distribution.  Several  authors  have  discussed  bivar- 
iate exponential  distributions,  including  Downton  (1970),  who  makes  some  compari- 
sons with  those  of  Gumbel,  Moran  and  Marshall-Olkin . The  distribution  to  be 
discussed  here  does  not  appear  to  be  one  of  the  earlier  ones,  although  it  is 
fair  to  say  that  in  common  with  earlier  ones,  it  is  not  the  'perfect'  bivariate 
exponential. 

The  double  Laplace  transform  of  the  joint  pdf  of  X^  and  Xi+1  is 


easily  calculated  using  (1.1);  the  required  expectation  is 

(s.,s_) 


pf  “SlXi"S2Xi+l,  ** 

Y 

Xi,Ai+l  1 1 


-Bs.e  -8s  e -Bs  e -s  (Be  ) 

- E{e  11  2 1+1  >B2  + E{e  112  1+1  1+2  }B(l-8) 

+ E{e"*1<8El+Ci+l>"S82El+1)6a-S) 

♦ E(e'Sl(6El+El+l)'B2(SEl+l+El+2)}(l-6)2, 


(5.1) 


which  can  be  written 


4*  X (b1»82) 

V*i+1  1 


*(Bs1)  [B*(Bs2)+(1-B)*(s1+6s2)  ] [B+(1-B)*(s2)  ] 
X2(A+Bs1+Bs2) 


(5.2) 


(A+Bs^)  (A+s2)  (X+s^+6s2) 

We  note  that  (5.3)  is  not  symmetrical  in  s^  and  &2,  and  this  is  to  be 
expected  since  the  process  is  not  time  reversible;  this  is  one  feature  which 
distinguishes  it  from  earlier  bivariate  exponentials.  The  backward  moving 
average  model  (1.3)  corresponding  to  (1.1)  has  the  joint  interval  distribution 
which  is  specified  by  (4.3)  with  s^  and  s2  interchanged. 


(5.3) 
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An  explicit  form  of  the  joint  distribution  (5.3)  can  be  obtained 
directly,  rather  than  by  inversion  of  the  transform  which  is  less 

informative.  By  the  structure  of  the  model  the  joint  distribution  of  (X^.X^j) 
is  a mixture  of  the  joint  distributions  of  (Be^.Be^^),  (8E^,8e^+j-t€^  ), 

^i^i+l'^i+l^  and  ^ei4€i+l*®Ei+l+ei+2^  wit^  tlie  corresponding  probabili- 
ties e2,  8(1-6),  6(1-8)  and  (1-6)2.  These  joint  pdf’s  can  be  listed  in 

an  obvious  notation  as  follows: 

f«r  Rr  (x’X>  - (X/B)e"(X/B)x(X/8)e"(X/B)y,  (x,y>0) 

Bei,B  i+1 

:g.  g_  (x,y)  - Xe‘Xx(l-6)-1[Xe“Xy-Xe"(X/8)y],  (x,y>0) 

8VBei+r*i+2 

*<ip  (x,y)  - (X/8)e"(X/B)(x_y/B)(X/6)e“(X/8)yt  (6x>y>0) 

fiGi  Gi+rBei+i 

x2e-(X/6)x[eX(l-6)y/62_e-Xy]/(1B+B2^  (gx>y>0) 

X2[e“X(1“B)x-e"(X/B)x]e”Xy/(l-6f62).  (y>8x>0) . (5.4) 

We  thu9  see  that  the  joint  pdf  of  X^.X^^  will  be  continuous  in  both  variables 

but  will  have  different  analytical  expressions  over  the  regions  6x  > y and 
Bx  < y ; there  appears  to  be  no  compact  analytical  form  for  f_  Y (x,y)  . 

V i+1 

This  is  unfortunate  because  it  makes  it  difficult  to  derive  maximum  likelihood 
estimates  of  the  parameters  X and  6 in  the  model. 


BeiJ'Ei+l,Bei+r  ei+2 


(x,y)  - 
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Different  bivariate  exponentials  also  can  be  compared  through 
their  conditional  properties  and  so  we  will  derive  these  for  the  present 


distribution.  Conditional  pdf's  are  not  succinct  enough,  and  so  we 
concentrate  on  conditional  moments.  These  may  be  obtained  from  (5.3).  For 
Instance,  to  obtain  E(Xi|Xi_^-t)  we  differentiate  with  respect  to  set 

s,,  - Of,  invert  with  respect  to  s^  and  then  divide  by  the  marginal  (exponen- 
tial) density  of  X^  The  two  conditional  means  are  in  this  way  found  to  be 

E(XilXi-l"t)  " + Jf5|  + -Jig  e_X(1"e)t/B]  (5.5) 


and 


E(X1|xi+1-t)  - X"1[l+B-e”(1_e)Xt/3] . 


(5.6) 


Thus,  both  regressions  have  exponential  components;  this  property  is  shared  by 
the  Marshall  and  Olkin  bivariate  distribution,  although  that  distribution  has 
a singular  component  along  X^  ■ X^+^.  For  the  continuous  distribution  treated 
by  Downton  both  the  conditional  means  are  linear,  as  are  the  conditional 
variances . 

Examining  these  regression  functions  more  closely  we  see  that  E(X^|x^+^»t) 
is  equal  to  X X for  8*0  or  8 ■ 1;  otherwise  it  increases  exponentially 
from  6X  to  the  constant  value  (1+8)X  1 as  t increases.  The  transient 
is  long  for  8 close  to  1,  but  very  short  when  8 is  close  to  0.  Thus  unlike 
the  serial  correlation  coefficient  there  is  differentiation  in  this  condi- 

tional mean  between  the  cases  where  the  parameter  is  8 and  the  case  when  it 
has  value  1-8* 

The  conditional  mean  (5.5)  is  more  complex.  It  starts  at  t - 0 with 
value  X * and  negative  slope  8-1.  There  is  a unique  minimum  at  t ■ 

-8  in  B/{ X (1—8) } and  the  function  eventually  increases  linearly  with  t.  Since 
we  have  for  large  t that 
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eex1ixi-i-c)  ~ *_i|jt] + st* 

the  rate  of  increase  depends  only  on  8,  not  on  X. 

The  conditional  variances  ror  the  present  bivariate  exponential  are 
also  exponential  functions,  and  their  explicit  forms  are  given  by 


Varfv  lx  - x-2|ll2g±2g?  + 2B2(1+Xt)  -(l-B)Xt/B 

var(Ai|Xi_i*t)  * X + 1Hj  e 


B2  “2(l-B)Xt/B 

(Tap  e 


(5.7) 


and 


varcxj - r2[i±e±^i  -2{£  + (5.8) 


These  conditional  variances  are  quite  different  forms  as  shown  in  Figures  3 
and  4.  In  practice  it  is  clear  that  conditional  means  and  variance  could  only 
be  calculated  for  t in  the  more  central  regions  of  the  marginal  distributions. 
In  these  situations  Var  (X^Jx^)  is  fairly  constant,  while  Var(XjJx^+j) 
is  reasonably  linear  in  t.  In  all  cases  the  asymptotic  values  are  reached 
much  quicker  for  the  lower  value  of  8. 
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6.  The  Conditional  Correlation  of  X^,  Xi+1  given  XA 

We  now  wish  to  carry  the  study  of  dependence  in  the  sequence  of  intervals 
{X^  a step  further,  in  particular  to  trlvariate  distributions.  The  dependence 
in  the  EMA1  process  has  a very  particular  structure:  X^  is  dependent  on  X^_^  and 
Xi+1  but  not  on  X^,  Xi+2,  X^,  Xi+3,  and  so  on.  It  thus  appears  that  the 
joint  distribution  of  Xj_^,  X^,  Xi+1  has  some  natural  significance  for  this 
process,  and  it  will  be  a trivariate  exponential  distribution;  we  should  note 
however  that  in  view  of  the  coupling  effect  of  the  dependence,  this  trivariate 
distribution  is  not  enough  to  describe  completely  the  dependence  in  the  sequence 
{X^}.  In  particular  the  sequence  is  certainly  not  Markovian  since  the  distri- 
bution of  Xi+j  Ix^Xj^j  will  depend  on  the  value  of  X^, . 

The  process,  by  its  structure,  has  the  somewhat  strange  feature  that 
although  X^_^  and  X^+1  both  depend  on  X^  the  variables  X^_1  and  X^+1 
are  Independent.  For  this  reason,  it  is  felt  that  the  joint  distribution  of 
Xj_^  and  X^+1  conditional  on  X^  is  of  interest,  and  we  shall  give  calcula- 
tions of  the  conditional  correlation  of  X^  and  Xi+1  given  X^  ■ t.  The 
other  two  pairwise  conditional  joint  distributions  may  also  of  course  be  used, 
but  the  corresponding  unconditional  joint  distributions  show  that  the  Intervals 
concerned  are  not  independent.  We  think  of  the  conditional  correlation,  written 
Corr(Xi_^,  xi+jJx^  • t) , as  a descriptive  function  of  the  higher  order  dependence, 
with  the  thought  that  it  may  be  used  comparatively  with  other  trivariate 
exponentials.  The  general  properties  of  conditional  correlations  are  not  well 
understood,  but  Lawrance  (1975)  has  shown  that  it  is  equal  to  the  corresponding 
partial  correlation  only  in  very  special  cases,  one  of  which  is  the  trivariate 
normal,  and  the  present  distribution  is  not  one  of  these  cases. 

The  triple  Laplace  transform  of  the  joint  p.d.f.  of  X^^,  X^,  Xi+1  is 
calculated  by  a straightforward  extension  of  the  procedure  used  to  obtain  the 
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bivariate  Laplace  transform  at  (5.2).  The  result  is  the  sum  of  eight  expecta- 
tion terms  with  their  associated  hinomial  probabilities,  and  can  be  cast  in 
the  form 


vt  *8ixi-r  a2xrs3xi+ii  _ ***  . m m v 

El©  * fv  Y Y '®i  »®9»®oJ 

1-1*  1*  1+1  1 J 


i|»(Bs1)  {B4»(Bs2)  + (1-B)  ♦(s1+6s2)}  {8^(Bs3)  + (1-B)  i|/(82+083)  {0  +(1+B)  <p(s  )}. 


(6.1) 


This  reduces  to  the  appropriate  bivariate  distribtuions  where  one  s is  set  to 
zero.  Before  passing  to  the  conditional  moments,  we  may  note  that  the 
generalization  of  (6.1)  to  r adjacent  intervals  is 


E(exp[-  l 8 X.]}-  KBs.)  n I$K6s,)+(1-B)  iKs,  .+  s.)][B+(l-B)  ♦(•>]. 
i-1  1 1 j-2  J J A J r 

(6.2) 


When  s^  - s2  ■ • • • « sr  we  recover  the  result  for  X^  + X2  + • • • + 
given  at  (3.5). 

We  now  return  to  Corr(X^_^,  |x^  ■ t)  which  we  shall  denote  as  P2(t) 
the  conditional  correlation  of  and  xi+^  given  X^  ■ t.  This  has  the 

explicit  expression 


E(Xi-l’Xi+l,Xi"t)  “ E(Xi-llXi“t>  E(X1+1|Xi-t) 

^2^  * i I 1/2  * 

lVar(Xi_1|xi-t)  VarOC^Ix^t)]1^ 

In  view  of  the  results  (5.5)-(5.S),  there  only  remains  to  calculate 
E(Xj_^,  X^Jx^t).  This  is  obtained  from  (6.1)  by  inverting 
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(6.3) 


l 


as  a function  of  b^  » to  recover  the  variable  t.  After  subtraction  of  the 
product  of  the  conditional  means,  we  have  for  the  conditional  covariance 


Cov(X^_i  ,X1+1  |Xj"t) 

. . + {(W)te  -b,  j.  e-2(i-e)xt/e  • 


Hence  the  expression  for  p2(t)  and  the  graphs  given  in  Fig.  5.  The  conditional 
correlation  is  far  from  constant  in  t,  although  in  the  range  (0,2X),  within 
which  it  would  be  possible  to  estimate  it  in  practice,  the  values  are  positive 


and  small. 


7.  Stationary  Initial  Conditions 


Up  to  this  point  we  have  dwelt  on  aspects  of  the  process  which  involve 
the  intervals  between  the  events,  we  have  emphasized  that  these  ere  a corre- 
lated but  stationary  sequence  of  exponential  variables.  This  situation  is 
typified  by  the  choice  of  an  arbitrary  event  for  the  initial  point  of  a 
sequence  of  Intervals.  We  now  consider  the  corresponding  problem  when  the 
initial  point  is  chosen  without  knowledge  of  the  event  times;  this  is  usually 
called  an  arbitrary  time  and  is  of  interest  when  stationarity  in  the  counts 
of  events  is  suggested  (Cox  and  Lewis,  1966,  Chapter  4),  as  opposed  to 
stationarity  in  the  Intervals  between  events.  However,  for  stationarity  in 
counts  of  events,  the  initial  point  of  the  interval  of  the  counting  must  be 
chosen  in  a particular  probabilistic  way.  We  shall  now  obtain  the  appropriate 
initial  conditions,  using  the  approach  and  definition  discussed  in  Lawrance 
(1972)  in  which  the  process  is  considered  at  time  t and  t is  then  allowed 
to  tend  to  infinity.  The  sequence  of  intervals  between  events  beginning  with 
the  arbitrary  time,  usually  called  the  asynchronous  sequence,  is  not  exponen- 
tial or  stationary,  but  the  counting  variable  of  this  sequence  has  stationary 
increments,  although  not  Poisson  distributed. 

At  time  t in  the  process  (after  a start  in  any  convenient  way)  it  is 
apparent  that  for  the  process  to  continue,  we  must  specify: 

(i)  the  time  to  the  next  event  in  the  {X^}  sequence,  and 
(ii)  the  random  variable  *s  associated  with  the  end  of  the 

X^^  interval  covering  t.  The  first  of  these  will  be  denoted  by  x and  *8 
just  the  forward  recurrence  time  of  the  EMAI  process,  and  this  is  bound  asymp- 
totically to  be  exponential,  but  it  will  be  dependent  on  the  second,  denoted 
by  e which  will  not  be  exponential,  even  asymptotically.  It  is  their  joint 
distribution  as  t -*■  « which  gives  the  required  initial  conditions. 
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Suppose  the  process  starts  at  t - 0 in  the  synchronous  mode,  and 
suppose  that  in  (0,t]  there  are  r-1  events.  Let  the  joint  pdf  of  Tr_^ 
and  Be  be  f_  (x,y).  When  the  interval  is  of  the  Be  fora, 

r Vl,Pr  r 

then  the  joint  pdf  for  (x  ■ w,  e - z)  is 


fT  Be  (x»t“x+M)dx  * (z), 
r-1*  r 


(7.1) 


where  * (z)  is  the  pdf  of  e . If  the  interval  is  of  the  Be  + e 

® r+x  r r+i 

form,  there  are  two  similar  expressions  according  as  z < w or  z > w;  these 
are 


and 


fT  Be  (x»t“x+w“z)dx  ’J'gCz) 
r-1*  r 


(z  < w) 


(7.2) 


t-(z-w) 

fT  ft-  (x,t-x+w-z)dx  ^ (z) . (z>w)  (7.3) 

x-0  Tr-l**r  e 


The  expressions  become  evident  on  considering  the  configuration  of  events. 
The  joint  pdf  of  x and  e at  time  t may  thus  be  written 


f (w,z;t) 


I fT  (x,t-x+w)dx  * (z)  with  probability  B 

r-0  Jx«0  r-l*B  r e 


I fT  a-  (x,t-x+w-z)dx  ^ (z) 

r-0  Jx-0  Tr-l’8er  e 

“ r t-(z-w) 

I fT  fir  (x,t~x+W-z)dx  $ ( z) 

r-0  jx-0  r-1’  r e 


(z  < w) 


(z  > w) 


(7. A) 

with 

probability 

1-8. 


The  r-0  and  1 terms  here  are  really  special  cases,  but  will  not  contrib- 
ute as  t -*■  “ and  do  not  need  to  be  obtained  explicitly.  We  shall  now  use 
the  result  that 


lim  f (w,z;t)  - lim  sf*(w,z;s)  - f (w,z)  (7.5) 

t-*»  x*e  s-0  x’e 
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to  obtain  the  limit  distribution  at  an  arbitrary  time.  Now  for  the  Laplace 


transform  with  respect  to  t of  (7. A)  we  need  the  joint  pdf  of  Tr_^  and 
0er,  which  by  (3.4)  is 

fT  Be  (x,y^  " ( C (x-u)k(u,y)du,  (7.6) 

r-l,p  r 'u*0 

and  in  terms  of  Laplace  and  double  Laplace  transforms 

C*_1(s)  - ^ (8s)  (s ,6s)  ] r“2 , and  k**(s1>s2)  - Bip  (Ss^  + (l-BJiKSj+Bs^  • (7.7) 


Hence  the  Laplace  transform  with  respect  to  t of  the  first  line  of  (7.4) 
after  ignoring  the  r * 0 and  r = 1 terms  is 


iH8s)  | | -su-sa 

*s)  Ju-0  Ja„0  e 


k(u,a4v)duda  <|>£(z). 


Taking  the  limit  as  in  (7.5)  then  gives 


(7.8) 


v<J'£(z) 


a*0 


k(u,a4w)duda 


v<|»e(z) 


f.  a+w)da 
b e 


v4'e(w/B)ij»e(z).  (7.9) 


where  v is  the  mean  of  the  e distribution  and  V (z)  is  its  survivor 
function.  The  limits  of  the  other  terms  in  (7.4)  can  similarly  be  obtained, 
and  give  the  final  result  as 


<v  1 

H’e(w/8)ipe(z) 

z,w 

> 0 

with  probability 
6 

fY  e<W»Z>  ■ < 

V-1 

¥ ( (w-z)/8)i|>  (z) 

0 < 

Z < W 1 

| (7.10) 

X »e 

C E 

1 

f with  probability 

-1 

1 

| 1-  s 

' V 1 

*e(z) 

0 < 

w < z ' 
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The  marginal  distribution  of  e has  pdf 

fe(z)  " $*e(z)  + (7.11) 

The  marginal  distribution  of  x is  in  general  rather  complicated,  but  in  the 
EMAI  case  is  exponential  with  parameter  X.  From  (7.11)  we  see  that  in  the 
EMAI  case  the  distribution  of  the  first  e variable  after  an  arbitrary  time 
(e)  is  the  weighted  sum  of  exponential  and  Erlang  2 distributions.  This  result 
Implies  that  the  second  asynchronous  interval  does  not  have  the  exponential 
distribution,  although  all  the  following  intervals  do;  the  non-stationarity  of 
the  asynchronous  sequence  of  intervals  is  thus  caused  only  by  the  second  interval. 

The  distribution  for  the  number  of  events  in  (0,t]  when  t ■ 0 is 
an  arbitrary  time,  that  is  in  the  stationary  situation,  may  now  be  obtained 
directly.  As  in  the  synchronous  case  of  section  3 we  need  the  distribution 
of  the  time  to  the  event  for  r Jfe  1.  The  function  <J>^(s^,s2)  of  section 

3 is  now  the  double  Laplace  transform  of  (7.10),  and  so 

4>l(8i,s2)  - ^"[♦(s2)  -<Kes1){B<Ks2)+  (1-6)i|>(s1+s2)}]  . (7.12) 

Generally,  for  the  double  Laplace  transform  of  the  pdf  of  Tf  and  £r+^ 
measured  from  an  arbitrary  event,  we  have  as  at  (3.2), 

^r(s1,s2)  - i(;(s1,s2)[^(s1,es1)]r’2  ♦1(s1,Bs1)  (r*2).  (7.13) 

This  leads,  using  (3.9)  to  the  Laplace  transform  of  the  pgf  of  N(t)  as 


is2+  [-B(l-B)z+  2B  + ll\s+  [l+g(l-e)z(l- 
(s+X){f}  (1+6)8*  + (l+2B-28z)Xs+  (l-z)X*} 
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Setting  6-0  or  1 reduces  this  to  the  Poisson  process  result  and  reminds 
us  that  the  distribution  of  N(t)  here  can  be  considered  as  a generalization 
of  the  Poisson  distribution  appropriate  to  counting  events  in  a correlated 
exponential  sequence.  The  customary  differentiations  and  inversions  of  (7.14) 
give 

E{N(t)>  - Xt 
and 

Var{N(t)}  - [l+2B(l-B)]Xt-  26(1-6)  (1+6+62) -||^5p-[(62+e)2e"Xt/(62+e)-e"Xt]  (7.15) 

when  B2  + 6 1;  there  is  an  individual  expression  for  (7.15)  when  02  + 6 - 1. 

We  notice  that  the  distribution  is  asymptotically  over  dispersed  as  compared 
to  the  Poisson  distribution.  The  results  (7.14),  (7.15)  may  also  be  obtained 
from  general  theory  and  the  previous  synchronous  results,  but  the  initial 
conditions  have  much  wider  applicability. 

We  have  then  been  able  to  explicitly  obtain  the  main  probabilistic  prop- 
erties of  the  EMA1  process  in  respect  of  stationary  intervals  and  stationary 
counts;  the  process  is  thus  unusually  tractable,  and  this  is  of  considerable 
merit  as  compared  with  many  other  models. 
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8.  Conclusions  and  Extensions 


There  are  several  extensions  to  both  the  first  order  autoregressive 
and  moving  average  point  porcesses  and  sequences  which  will  be  considered 
subsequently: 

(i)  By  replacing  ei+1  in  (1.1)  with  Y£i+^  with  probability  Y 
and  with  Y£i+^  + e±+2  we  °^ta^n  a second  order  moving  average 
process.  This  may  be  extended  to  any  order;  like  the  present 
model  the  serial  correlations  are  restricted  to  lie  between  0 
and  1/4. 

(il)  The  autoregressive  and  moving  average  structures  can  be  combined 

to  give  what  appears  to  be  a much  richer  class  of  processes. 

(ill)  In  Gaver  and  Lewis  (1975)  it  is  shown  that  is  the  is  taken 

to  be  Gamma  distributed  (K,X),  then  the  solution  to  (1.2)  shows 

k 

that  has  Laplace  transform  { (pX+s)/(X+s))  and  this  Is  the 

Laplace  transform  of  an  infinitely  divisible  distribution.  Thus 
autoregressive,  moving  average  and  mixed  Gamma  processes  can  be 
constructed.  Their  properties  are  much  more  complex  than  the 
corresponding  exponential  processes,  but  are  tractable. 

The  KMA1  and  EMAp  processes  are  easily  simulated,  as  are  the  Gamma 
processes  for  integer  k.  Estimation  problems  remain  to  be  considered;  they 
are  treated  for  the  first-order  autoregressive  processes  in  Gaver  and  Lewis 
(1975).  The  use  of  the  EMA1  sequence  and  point  process  in  cluster  processes, 
congestion  models  and  computer  systems  models  will  be  discussed  elsewhere. 
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Figure  Captions 


Figure  1.  The  intensity  function  m^(t)  for  the  EMA1  process.  The  functions 
is  plotted  for  values  3 - 0.1,  0.3,  0.5,  0.7  and  0.9  and  X ■ 1.  The 
deviation  from  the  constant,  Poisson  process  value  X - 1 is  small.  Unlike 
the  serial  correlations  for  intervals  this  function  does  discriminate  between 
the  cases  3 and  1-3. 

Figure  2.  The  spectrum  of  counts  g+(w)  for  the  EMA1  process.  The  spectrum 
is  flat  with  value  1/tt  for  the  Poisson  process  (3  ■ 1 or  3 ■ 0) . Unlike 
the  spectrum  of  intervals  it  does  discriminate  between  the  cases  3 and  1-6. 

Figure  3.  The  conditional  variance  of  X^t  given  Xj,  ■ t,  for  the  bivariate 
exponential  distribution  (X  - 1)  arising  in  the  EMA1  process. 

Figure  4.  The  conditional  variance  of  X^  given  xi+1  " t,  for  the  bivariate 
exponential  distribution  (X  - 1)  arising  in  the  EMA1  process. 

Figure  5.  The  conditional  correlation  P2 (t)  for  intervals  X^  and  X^+^ , 
given  X^  - t,  for  the  EMA1  process.  The  joint  distribution  of  Xj_^,  X^, 

Xi+1  is  a trlvariate  exponential  distribution.  Again  there  is  differentiation 
between  the  cases  3 and  (1-3). 


